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that sdf-paang has been overemphasized m programed course., du 
results will depend on further research. (DS) 
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In the sutnmer of 1960 I wae Invited to Join the staff of the Encyclopedia 
Brltannlca Films, which at that time was doing pioneering work on programmed 
materials. Previous to this, experimentation on programmed mathematics was 
showing positive results, and It was felt that the principles which were 
being evolved for programmed mathematics could be adapted to foreign language 
teaching. My particular task was to see how these principles could be applied 
to Instruction In the German language. Fortunately the techniques my wife 
and I had developed for the teaching of German to grade-’School children were 
somewhat similar to programming, although at the time we were quite unaware 
of this fact. At any rate the transition from the problems of teaching 
German to third grade children to the problems of programming the language 
for older learners was not an laiposslble leap. Even so, the task was an 
arduous one, and we wrote, tested, and rewrote several times before the 
basic principles of teaching a foreign language by this means emerged. After 
two years we had accomplished the task and had completed our contract with 
Brltannlca. 



From the beginning there was one principle of programming that bothered 
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us no end: the principle of self-pacing. Some programmers took the attitude 

that the teacher was becoming obsolete and would be replaced by a machine In 
the future classroom. But nobody really tested and experimented with this 
principle. It was Just taken for granted that the best way for every student 
to learn was as his own Individual pace. As a consequence all programs then 
being written were geared to this approach. Including our own Gerpan program. 
No one seemed to be Inclined to ask whether some students perhaps profited 
from being In competition with their fellow learners, oi^ 'perhaps needed the 




support of another human being. 
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With the tenninatlon of my contract with E.B.F, I returned to teaching, 
determined to teat the validity of aelf-pacing in a prograeaned German courae. 
Although moat of the experimental aubjecta who had been uaed in the tea ting 
had done remarkably well, one could not deny the fact that they were paid 
to take the courae, were generally very auperior atudenta, and individuala 
with a good deal of inner motivation. Previoua yeara of teaching had warned 
me that even among college atudenta thia type of individual waa not the rule, 
but the exceptitov and it waa too much to aaauM that equal reaulta would be 
obtained by an ordinary claaa of college freahmen aubjected to all the 
diatractiona and foiblea that are uaually found in auch a group. In order 
to explore aome of theae ideaa, in the fall of 1962, at Colorado State 
Univeraity, I aet up two teaching aituationa, uaing our programoed materiala. 

In one claaa I aimply iaaued booka and tapea and aaked the atudenta to proceed 
to learn German with the help of a tape recorder. For the other claaa, we 
had the program put on tranaparenciea and with the help of an overhead 
projector, a loud apeaker for the recorder, and a acreen, I taught and directed 
the pace of the progreaa of the atudenta. Experience with felf-pacing had 
already indicated that problema in the area of language learning ahould be 
reaolved immediately, ao I encouraged the atudenta in thia teacher*directed 
claaa to interrupt whenever any point of atructure trou^dled them, or even to 
aak for a word or a phraae that might have eacaped them in thia kind of 
language give and take. I found that 99Z of theae queationa could be anawered 
adequately in Juat a few aeconda, and I openly uaed Engliah aa the baaia of 
explanation. I atringently avoided any long diacourae on the intricaciea 
of granaiar becauae thia merely tended to eonfuae the atudenta more than no 
anawer at all. I aoon diacovered alao that the type of queationa aaked put 
me on my toea, for the queationa were aaked out of a knowledge of German, not 
from an ignorance of German, ao that I had to anawer in a few aecond$queations 
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which were eherp and demanded a c&prehenalve view of the entire courae. 

At the aame time I could not ramble off on a tangent, aa the atudenta were 
eager to get the matter aettled and get back to the program. Once I reallied 
thla, I cerefully prepared each day* a work, trylt, to anticipate queatlona. 

In thla I waa aucceaaful and the cleaa moved et e feat pace, Ita apeed being 
only prrtly determined by me, and moatly by the atudenta themaelvea. They 
were learning; they knew It, and they wanted the new atructurea to come feat. 

The atudenta In the eelf-paced claaa were elao urged to aak queatlona 
whenever they needed help, but alnce each atudent waa at a different place In 
the program, queatlona had to be enawered Individually. Here we did not 
experience any 'awing* to the entire claaa, a. each Individual competed only 
with hlmaelf, and often the competition wea very poor! Before the year waa 
over, the P.ychology Department at the Unlveralty became Intereated In thla 
project and decided to help me conduct a more meaningful experiment by giving 
e variety of aptitude and attitude teata. The flrat yeer, however, waa 
important In that the experimentation, Inconclualve though It waa, did at 
leaat reduce acme of the troubleaome ereea. and It waa unqueatlonably true 
that the teata for the teacher-directed claaa Indicated that theae atudenta 
were learning more deeply and Intenalvely, aa well ea more enthualaatlcally. 

In the aecond year, aa In the flrat, we did not make any attempt to 
.elect atudenta according to Intelligence or any other factor. We felt we 
were Juatlfled In thla becauae all atudenta choo.lng <my l«>gu.ge courae at 
a Unlveralty gather aa a random group, we wanted to feel that the programned 
Inattuctlon waa being .objected to the aame condition, a. conventional 
claaaea, and the number of atudenta .elected German, or any other claaa, 
repreaent In any event only e .mail percentage of the atudent populetloB, a 
factor which In It.elf aomewhat mitigate, the validity of auch an experlm«>t. 
We frankly were not aeeklng conclu.lve reault. at thla point; we were merely 

aeeklng trend, upon which a more meaningful experiment could be baaed later. 
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One group of twenty-four student, net In e room equipped sonewhst like 
. language leborstory. Each student we. supplied with . tape recorder and a 
complete program which Included book, and tapes. They were required to bring 
only a notebook and pen to class. Then the student, were told to proceed at 

their own pac king help from the teecher when they felt the need. They 

were Informed, however, that they were expected to complete the program by 
the end of the academic yeer. This, of course, somewhat modified the concept 
of self-pacing, but It was necessary to Impose this llmlgatlon on them for 
their own protection, because If any student dawdled to the extent that he 
did not finish the first-year prograsmed German course, he would he at a 
serious disadvantage In the second year, and he could hardly have received 
full credit for the first-year course. The other class started with thirty- 
four members, meeting In an ordinary classroom. Using the transparencies 
with the overhead, the program was projected, one f ram; at a time, onto a 
screen, «id a single tape recorder set on loud speaker was operated hy the 
teacher. The class responded In unison when an oral reaponse was required. 

Por written responses each student kept a notebook. The teacher stood so 
that he could see when student, were finished writing and paced the presente- 
flon of the next framt accordingly. He could also detect gross errors In 
pronunciation and drill the class In the correct response without causing 
embarrassment to any Individual. Both classes were scheduled to meet five 
times a week for an hour at a time. Exmolnatlon. were administered at the 
end of every thousand frames. The students In the self-paced class Informsd 
the teacher when they reached these point. ««d the test, were given Individually, 
The teacher-directed class took the. as a class, just a. any convettlonal class 
would do. The teacher was always present during the hour that the self-paced 
class was acheduled to meet so that student, were free to ask question. If 
they needed help. The room was also open at some extra hours, so that those 



student, who worked more slowly could come In «.d continue with the progrem. 
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It was well that we allowed ourselves one full year to becoine acquainted 
with some of the difficulties In a prograifid class, both self-paced and teacher- 
directed. We fould that we had not allowed sufficient time In the teacher- 
paced class to finish the program, so the second year we scheduled the two 
programmed classes for two hours a day, ten hours a week, although the same 
credit (5 hours) was given as was given for any of the university's beginning 
language classes. This extra allotment of class time was justified on the 
basis that students In the programmed classes had no homework assignments, 
while students In conventional classes were expected to spend from one to two 
hours a day In preparation for each class session. Although we wondered 

whether this two-hour scheduling would deter students from registering for 
the course, our fears were unfounded. As In the first year, we again had 
twenty-four self-pacers, that being the nuB&er of available tape recorders 
and programs, and there were thirty-five In the teacher-paced classs The two 
hours were not consecutive. The first hour for each class met In the morning, 
and the second hour for each was scheduled In the late afternoon. A student 
agtittant was hired to oversee the self-pacers and to operate the overhead 
projector and tape recorder for the teacher-paced group during the second 
dally session, thus relieving the teacher of an undue load. All questAons 
that the students had were deferred by the student assistant and answered by 
the regular teacher on the following day, a rather unsatisfactory arrange- 
ment perhaps, but the best we could devise. 

In the teacher-paced group, the entire class completed the program early 
In May and spent the last few weeks of the spring quarter reading and carrying 
on discussions In German. At this tlsw also this class was reduced to one 
hour a day Instead of the originally scheduled two-hours. Of the twenty-four 



seU-pacert that startad In tha fall, only twelva complatad tha yaar'a work, 
with an avaraga acora of 3.1 In tha final axam, whlla tha avaraga of tha 
taachar-pacad group was 3.2. Ona must baar In Bind that that avaraga for 



tha lattar group Includaa waak atudanta at wall at good, for all complatad 
tha courta and took the final, whlla the talf-pacad avaraga doat not Include 
tha poorer atudanta, none of whom complatad tha courta and took tha final. 

In order to have tome more objective maaauremantt of how tha atudanta were 
reacting to thla method of Inttructlon and how ttich they were learning, the 
Paychology Department of Colorado State Onlvartlty cooperated with me during 
thla aecond year by admlnlatarlng a number of teata. We ware not content 
merely to teat programmed matarlala agalnat conventional materlala, but we 
wlahed above all to determine whether prograanad Inttructlon would have 
any validity without tha elamant of aalf-paclng. Teata ware, therefore, 
admlnlatared to three groupa. tha data taking tha German program under a 
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aelf-paced altuatlon, the data taking the program with tha teacher helping 
to determine the pace, and aeveral elaaaaa taking German In a conventional 
altuatlon, ualng a textbook and having homework aaalgnad to be dona either 
at home or In the language department 'a laboratory. Flrat of all, tha 
atudanta In every one of theaa daaaea wara given the Carroll-Sapon language 
aptitude teat. In theae teata the probability la that thoae who acore hl^ 
have a better poaalblllty of doing well provided the Inatructlon la of high 
quality, thla latter being one of the uncontrolled varlablea In the experiment, 
At varloua tlmea during the year, attitude teata were admlnlatared to ell 
atudanta In the different daaaea. Theae teata were created by Dr. Charlea 
Neldt, head of the paychology department, and a pioneer In the field of 
attitude meaaurement. Theae teata were deatgned to aee how the atudanta were 
reacting to the method uaed, whether they were aatlaf led with the approach 
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,nd finally whether their Initial attitude va. maintained a. the year 
progreaaed and the novelty wore off. FlneUy « the end of the year, all 
enaae be.lnnln. Carman student, were given the ETS (Educational Te.tlng 
Sarvlce) atandardlzed German examination (written form only). Thl. teat 
1. dealgned to measure the studenf. s«.tery of various elem«.t. In the 
language. Although the student. In the progr-msed classes did not show the 
highest aptitude for language learning according to the Carroll Sapo 
these student, consistently .cored highest on the attitude scales, and cse 
out on top in the ETS achl*v«sent test. Of the two progrmsed classes, the 

^ „ h.d th. lower aptitude score, but the higher attitude 

teacher-directed group had the lower apti 

and achievement acorea. 

U 4 ii«<afrate the reaulta of the teata given. The 
The accompanying graphs Illustrate tne ra 

aptitude and achievement test, are nationally known. The attitude tests, a. 

1 have indicated, were developed at Colorado State Onlver.lty under the 
direction of Dr. Het«t. A. one can a... the nu*er of studdnt. test, was 
.mail. that fact detract, from th. validity of th. «.tlr. venture. Tet. 
in spit, of this, there are some Inter.. ting tr«.d. here, which should be 

dltcutted. 

First, let me say • 

Th. at«.dardlx.d Cers-n teat given ha. b.«. deigned .xpr...ly for .t»d«.t. 
being prepared In a conventional l«igu.g. course. only the wtttten 
form, were used. In this, heavy «sph..U L PUcO »« 

vocabulary, a knowledge of rule, of gras-r «.d -emorla.tlon of Idiomatic 
conatructlons. In th. progra-sed course, on th. other h««d. the -spha.l. 

1 , on ll.t«ilng comprehension «.d automatic response. In accept-.!. Ge«s«. 

. . tuch may be MUcovered* by the ttudent 

to eurel •tlmull. Grimmer rulei ei lucn y 

K MM f Ami liar with a itructure throu^ uiage. Once the itudent 
after he hai become familiar wicn 
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has formulated his own rules, they are used as reminders, to help inhibit 
errors in the future. Vocabulary is necessarily very limited as the emphasis 
is upon gaining control of structure rather than sterile memorization of 
isolated words or idioms. Thus the really strong points of the program 
were not tested in the ETS examination used, so that the students in the 
conventional classes had an advantage over those in the prograinned classes. 

One must also keep in mind the relationship of the aptitude scores with 
the achievement scores. Conventional teacher two, with a class of only eight 
students whose average aptitude; was 70.75 had the second highest achievement 



[ score of 50.38, which is .21 above the self-paced programed class, whose 

I average aptitude was 66.17, more than four points below that of this small 

I conv6titional class* Notica^ too^ that tha aptituda of tha taachar-pacad 

\ 

I class was only 59.36, and one of the conventional classes had an aptitude 

j score of 58.26, a difference of about one point. Yet on the achievement of 

j these two comparable groups, the teacher-directed programmed class surpassed 

j the conventional group by nearly fifteen points. The reader must be reminded that 

I the number completing the various German courses, programmed and conventional, 

I is very small, so that validity of the scores can be questioned. One may well 

ask, however, what the score of the class would have been if the teacher-paced 

I 

I group had had as high an aptitude score as the highest scoring conventional class (70,75), 
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Notice that the average achievement for all classes of 44.00, and both programmed groups 
scored well above this. Likewise, the average aptitude score is 62.50, above the score 
of the teacher-paced class, although below that of the self-paced class. It 
is easy to conclude from these figures that even though the achievement tests 
did not measure the skills that were given the most emphasis in the program, these 
students more than held their own with students receiving the 
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convent tonal type instruction which the tests were designed to measure* 

It is Impossible to say how much the achievement scores were affected by the 
better attitude of the students In the programmed class. Undoubtedly, 
attitude plays a large part in learning* And as I indicated earlier. It 
is not possible to say what part was played by the personalities of the 
various teachers involved* 

These charts are making a comparison between different methods being 
employed by teachers to train students In the use of the German language* 
Besides this, they make a comparison between a program being used In a 
self-paced and a teacher-paced situation* Our experiment here would Indicate 
that the element of self-pacing may have been over-emphasized* Perhaps the 
grouping of students according to speed of learning is adequate, so that a 
program would be paced to meet the needs of each group* It is highly possible 
that students stimulate each other in the learning situation, especially 
under the conditions of the program where all of them were Involved with 
the stimulus-response procedure all of the time* The final answer, after 
all, may very well lie in a combination of the best features of conventional 
teaching with the best features of programmed Instimctlon* 

We do not claim for a moment that the material presented in this paper, 
or even in the graphs. Is final and conclusive* Lest someone should be 
inclined to so Interpret it, let me point out here some of the various and 

obvious weaknesses of the experiment* 

1* We had no adequate controls* At the time we did not feel this 
was serious, as we were more Interested In trying out some ideas than in 
reaching conclusions* We do believe, however, that our experimentation may 
stimulate some research in this area which will produce conclusive results* 




2. Only one teacher wee Involved In the progreimned pert of the 
.xp.rlm.nt, .nd, to m-c. m.tt.r. vor... th.t t..ch.r w.. th. .uthor of th. 
proir« .nd h. nntur.lly .xud.d .U kind, of «ithu.l..m, Vhlch undoubtodly 
.ff.ct.d th. .ttltud.. «.d p.rh.p. ov« th. .chl.o«»nt of hi. .tud.nt.. 

3. A ..rlou. »..kn... .ro.. from th. f.ct th.t n.lth.r th. .dmlnl.tr. 



tlon nor th. l»ipu.g. d.p.rt«.nt .t Color.do St.t. Unlvr.lty w.. wining to 
Und It. support .nd h.cklng to thl.-.xp.rl«.nt. Th. l.ngu.g. t..ch.r. .t 
th. institution knw nothing .bout progr««lng «id c.rod loss, snd this 
.ttltud. W.S sh.r.d by th. .dmlnl.tr.tlon to som. «tt«it. This, too, msy 

have effected the etudente In the conventional cleeeee. 

4. A studont ..slst«.t u..d to t..ch th. .ft.moon hour, of th. 
progrmmMd cour... This fsct, w. f..l, d.tfctl fro- th. v.lldlty of th. 
.xp.rlm.nt, for whll. .h. w.s h.r..lf . compotwt .tudont .nd h.d compl.tod 
th. progtMi during th. first y..r It w.s off. rod, sh. w.s not sbl. to 
«,s».r quostlon. sd.,u<t.ly. W. should h.y. h.d . rogul.rly .sployd 

German teacher. 

with th... w.Skn.st.s, «S *.11 .. th. r.sult. of th. .xp.rlm«it. In 

mind, w. would Ilk. to .ugg.st som. furth.r .r... of r....reh, 

1. If w. ..rlously consldor th. .ttltud. of th. .tud.nt hiring « 



.ff.ct upon hi. .blllty to u.lsdl.t. lo.mlng, th«. w. must .!«. consldor 
othor f.ctor. l.sdlng to th. .... rosults. W. must ov.lu.t. th. .ff.ct of 
gr.g.rlousn.ss, ..lf-confld«ic, .hyoss, snd porslstone. upon th. .blllty 
to l..m. HOW do th... p.r.on.llty tr.lt. .ff.ct .ttltud. «d .chl.v«»ntT 
2. In thl. r..yot .1.0 th. oh.r.et.r of th. t..eh.r m.y b. d.cl.lv.. 

An lm.gln.tlv., p.tl»t t..ch.r who .ppro.ch.. hi. subyct «.d hi. stud.nt. 
with .nthu.l«. for th. .ubl.ct »d with . .».. of humor «d und.r. tiding 
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of human nature c«> b. a maa.urrt.la £«:tor In th. aduc.tlon of th. laamar. 

C«. a progrm. trtt. co*nl.«.c. of auch factor, on th. part of th. .tudant and 
teacher? If It c«i. then thl. el.o moot be . reaearchabl. lt«i. 

3. Vlhat ex«!tly 1. the role of th. teacher In e pto«r«p.ed eout.., 
or. for that mattar. In a comput.r-...l.t.d progrm.? Our dxp.rlm«.t 
to indicate that progr«i.d Inatructlon put. a graater d««nlupon th. teacher 
th» «.y cony«.tlon.l ey.t«. c«». Perhap. that 1. uhy aom. teacher, have 
ahled »rey from ualng progrw! A good program atl«»lata. the 
think more deeply about th. .ubject being learned. «id th. learner will a.k 
queatlon. that will d«i«.d far gr.at.r knowledge on th. pert of th. teacher, 
the teacher will have to have a comprehanalve view of the entire courae In 

order to meet the demand, of future atudenta. 

4. A completely ..lf-p.c«l progr»» d««nd. a graat daal from th. average 

learner In th. way of motivation «id .olf-dleclpllne. The Idea that th. 
learner will find .ufflclent motivation lu.t b.c.;«. he uaually coma, up with 
th. right .newer he. not been valid with th. average fre.hm«. of my .c,ualnt«.ce. 
For th. well-dleclpllned. mature. «id highly motivated etudent. a good progrm. 

1. aomethlng he devour, happily. But thl. etudent In In a . c-U 
minority. What about th. greet majority? It at«id. to reaeon that eomathlng 
nuit be prepared that will maet th. need, of th. total achool population. 

Thle. w. believe, can be done by creating progrmmimd cour.e. that will keep 
the teacher actively engaged In th. Inotructlon. A progrm. cmi «»d .hould 
be wrltt«. for «.y eubject In auch . way that part, of th. cour.e c«i be 
uaed for group In.tructlon. with frm-e projected ao that the entire cl... 
c«. focu. on on. metaer et a glv«. Thl. approach 1. flenlbl. «.ourf. 

.0 that th. teacher c«. repeat fr«-a when h. find. It nactary. or «cp«.d 
nd clarify when he stnsts tbrt.a.particUb.r ckss ne.*4s such h«.»P- 
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Th. t..ch.r .hould .1.0 b. .bl. to .top th. progtn .t »y point In otd.r 
to drill hi. .tud«t.. Ev.n b.tt.t thu th.t, or p.rh.p. connoctod 1th It, 
void b. to h.v. on. or nor. drill . *n-c for thl. purpo... Thl. 1. 

non th. wro.ch b.lng «..d .t . n»d..r of colUg.., not.bl, .t 0*l«d 
Co»«nltT ColUg., 1th gr..t .ucc... thl. tort of drill 1. ..p.cl.lly 
indle.tl in .ubj.ct. .uch .. foreign lMgu.g.t «d »nth«.tlc.. Such drill 
eon.tltut.. ov.rl..mlng «d 1. ...«tl.l If r..l ...t.r, of th. .ubl.ct 1. 
to b. g.ln.d. A progr«. c« fnml.h Infot-tlon. bit It td». th. t..ch.r 

to mako tho tubjoct con* allvo for tho ttudont* 

In concision, l.t .. .1-ply .t.t. th.t 111. It 1. nndonbfdly tm. 
th.t .on. t..eh.r. think th.y c« go on t..ehlng th. to. old thing In th. 

old w.y. th. .nroll-»t .t our .u».r .chool. «d ln.tltut.. to.tlfl.. 
to th. f.ct th.t »»iy tho».«.d. of t..ch.r. .r. d..pc»kt.l* trying to k..p up 
1th n«> tochnology ««d n«r Mthod.. It 1. not th... t..ch.r. uho .r. 
ob.ol.t., but r.th.r th. tool. th.y .oMtln.. .r. ford to vork 1th uhlch 
.r. out-of-d.t.. It 1. up to th. er..tor. of t«tt. d progrw to ... 
th.t our con.cl«itlou. t..eh.r. h«r. th. Mt.rl.l. to u.. to th.t th.y c«i 
lnp.rt knouUdg. .nd .kill, to tholr pupil. In th. no.t .ff.ctlv. unn.r. 
Only th. lndlldu.1, vh.th.r .tud«t, t..ch.r, wrlt.r, .d 11 .tr.tor, or 
publLhor, vho f.ll. to t1. 1v.nt.g. of th. opportdty to try n»r Id..., 
nw B.t.rl.1., «id nw t.chnlqu.., c«i b. t.nd ob.ol.t.. Hot .y.n th. 
progruMr, Uho.. progrm 1. hot off th. pr..t, cm cl.l« to h.v. found 

the final way to impart knowledge. 



Emeat E. Ellert 
Oakland Coanunity College 
Union Lake 9 Michigan 
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Appendix A. Results of Teacher-peced Programed Instruction 

in German, 1963- 64 e 

Mean Achievement Scores at End o£ First 
Year German 
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(Data in preceding table plotted graphically.) 



Pinal Achievement Scores 
for Five Groups of Beginning German Students 



Group 


Number 


CTs German 
Examination Score 


FoMi^n Languag. 
Aptltuda Taat 
Score 


Teacher Paced 
Program 


11 


52.27 


59.36 


Self Paced 
Program 


6 


50.17 


66.17 


Conventional 
Teacher 11 


23 


37.52 


58.26 


Conventional 
Teacher 12 


8 


50.38 


70.75 


Miscellaneous 
Several Teachers 


28 


42.93 


64.07 


TOTAL 


76 


44.00 


62.50 
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PROJECTS 1. 2 and 19 

Mean Expectation Attitude Change 
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PROJECTS 1, 2 and 19 

Mean Method Attitude caiange 
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PROJECTS 1, 2 and 19 

Mean Content; Attitude Change 
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PROJECTS 1, 2 and 19 
Mean Total Attitude Change 
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^ enrolled in three inetructional 

Attitude scores for ®‘^f**"n J^Lter, 1963-64. 
groups in Beginning Genwn. First wuar 

(Bte higher the score the more favorable the attitude. ) 
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PROJECTS 1, 2 and 19 . 

Mean Content Attitude Change 
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